Human-computer dance interaction with realtime accelerometer control

https://www.youtube.com/watch?v=quYQuF0enIk

Author

Abstract

Motion-capture-based character animations are widely used in computer graphics and interactive games.In this paper, we show a novel approach to create dancing character animations that react to input music and an accelerometer manipulated by a user. Since the sensor reads express intensities of users' body movements, the system can synthesize character motions whose intensities are synchronized to those of users. Our system consists of analysis phase and synthesis phase. In the analysis phase, the musical beat and segments are detected from input sound, and motion rhythm and intensities are found from motion capture data. With the results of this analysis, we generate a motion graph that can generate character motions matched to the musical rhythm. In synthesis phase, the system receives the output data from an accelerometer and traverses the motion graph according to the matching result between the sensor data and the motion intensity. As the result, our system adds an interactive component to live dancing performed by virtual characters.

Source

Proceedings of the 20th ACM international conference on Multimedia (ACM-Multimedia 2012)

Commets

加速度センサで動きの激しさを計測、それに合わせたキャラクターを提示。

より一緒に踊った気分にさせる？

URL

Tag